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Abstract 

We establish heavy traffic limit theorems for queue-length processes in critically loaded 
single class queueing networks with state dependent arrival and service rates. A distin- 
guishing feature of our model is non-Markovian state dependence. The limit stochastic 
process is a continuous-path reflected process on the nonnegative orthant. We give an 
application to generalised Jackson networks with state-dependent rates. 
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1 Introduction 



Queueing systems with arrival and (or) service rates depending on the system's state arise 
in various application areas which include, among others, manufacturing, storage, service 
engineering, and communication and computer networks. Longer queues may lead to cus- 
tomers being discouraged to join the queue, or to faster processing, e.g., when human servers 
are involved, state-dependent features are present in congestion control protocols in com- 
munication networks, such as TCP (cf. [Tj 121 El ELT1 EE] and references therein for more 
detail). 
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In this paper, we consider an open network of single server queues where the arrival 
and service rates depend on the queue lengths. More specifically, the network comprises K 
single-server stations indexed 1 through K . Each station has an infinite capacity buffer and 
the jobs are processed according to the first-in-first-out discipline. The arrivals of jobs at 
the stations occur both externally, from the outside and internally, from the other stations. 
Upon service completion at a station, a customer is either routed to another station or exits 
the network. Any customer entering the network eventually leaves it. A distinguishing 
feature of the model is non-Markovian state dependence: the arrival and service processes 
are assumed to be time-changed "primitive" processes, where the time change is given by 
the integral of the queue-length-dependent rate. 

Our goal is to obtain limit theorems in critical loading for the queue length processes akin 
to standard diffusion approximation results available for generalised Jackson networks, see 
Reiman [15]. To this end, we consider a sequence of networks with similar structure indexed 
by n G IV. The limits are taken as n — > oo . The critical loading condition is assumed 
to hold in the limit. We show that if the network primitives satisfy limit theorems with 
continuous-path limits, then the multidimensional queue-length processes, when suitably 
scaled and normalised, converge to a reflected continuous-path process on the nonnegative 
orthant. If the limits of the primitives are diffusion processes, the limit stochastic process 
is a reflected diffusion with a state dependent drift and diffusion. We give an application 
to generalised Jackson networks with state-dependent rates thus providing an extension of 
Reiman's [15] results. In addition, we establish the existence and uniqueness of the solution 
to the equations governing the network. 

The results on the heavy traffic asymptotics in critical loading for state-dependent rates 
available in the literature are mostly confined to the case of diffusion limits for Markovian 
models (which assume state dependent Poisson arrival processes and exponential service 
times), see Chapter 8 of Kushner [9J, Mandelbaum and Pats and Yamada [17]. A 
Markovian closed network with state dependent rates has been considered in Krichagina [5] . 
Some non-Markovian models (with Poissonish arrivals) have been treated in Section 7 of 
Yamada |17j . 

A different class of results on diffusion approximation concerns queueing systems modeled 
on the many-server queue with a large number of servers. In such a system the service rate 
decreases to zero gradually with the number in the system (whereas in the model considered 
here it has a jump at zero, see (I2.1dl) ). so the limit process is an unconstrained diffusion, 
see, Massey, Mandelbaum, and Reiman [10], Pang, Talreja, and Whitt [12], and references 
therein. We do not consider those set-ups in this paper. 

The exposition is organised as follows. In the next section, we provide a precise descrip- 
tion of the model and introduce the hypotheses required for our main result. The statement 
of the limit theorem for the queue-length process and its proof are contained in Section [3j 
In Section @] an application to state-dependent generalised Jackson networks is presented. 
The appendix contains a proof of the pathwise queue-length construction underlying the 
definition of the model. 
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Some notational conventions are in order. We use =>- to represent convergence in dis- 
tribution of random elements with values in an appropriate metric space, all vectors are 
understood as column vectors, |x| denotes the Euclidean length of a vector x, its compo- 
nents are denoted by Xi, unless mentioned otherwise, superscript T is used to denote the 
transpose, 1a stands for the indicator function of an event A , Sij represents Kronecker's 
delta, [a\ denotes the integer part of a real number a . 

2 The non-Markovian state dependent queueing net- 
work 

2.1 The network structure 

Let (Q, J 7 , P) be a probability space where all random variables considered in this paper are 
assumed to be defined. For the n-th network and for i G IK, where IK = {1,2, ... , K}, let 
A2(t) represent the cumulative number of customers that arrive at station i from outside 
the network during the time interval [0, t], and let Df(t) represent the cumulative number 
of customers that are served at station i for the first t units of busy time of that sta- 
tion. Let J C IK represent the set of stations with actual arrivals so that A™(t) = if 
% J . We call A n = (A?,i G IK) and D n = (D?,i G IK), where A? = (A?(t),t > 0) 
and D™ = (Df(t),t > 0), the arrival process and service process for the n-th network, re- 
spectively. We associate with the stations of the network the processes = (3>y, j G IK), 
i G IK, where = ($™(m),m = 1,2,...), and $™(m) denotes the cumulative num- 
ber of customers among the first m customers that depart station % which go directly to 
station j. The process $ n = G IK) is referred to as the routing process. We con- 

sider the processes Af, Df and $" as random elements of the respective Skorohod spaces 
D([0,cx)),iR),©([0,oo),iR) and B([0,oo), M K ); accordingly, A n ,D n and $ n are regarded 
as random elements of D([0, oo), R K ), D([0, oo), M K ) and ©([0, oo), R KxK ), respectively. 
Throughout, S will be used to denote the K- dimensional non- negative orthant IR+. 

We now introduce the equations which specify the network. Let Xf , where i G IK, be 
Borel functions mapping S to M + , with A™(x) = if i ^ J , and let X n = (A™, . . . , A^) and 
fi n = (//", . . . , fig) . These functions have the meaning of state-dependent arrival and service 
rates. Let Nf' n = (Nf' n (t) ,t > 0) and N® ,n = (N®' n (t) ,t > 0) represent nondecreasing 
Z + - valued processes with trajectories in D([0, oo), M) and with Nf' n (0) = N^' n (0) = 0. We 
define Nf' n (t) = [t\ if i ^ J . (The latter is but a convenient convention. Since Xf(x) = 
if i ^ J , the process N i is immaterial, as the equations below show.) The state of the 
network at time t is represented by Q n {t) = (Qi(t), . . . , Qx(t)) , where Q™(t) represents the 
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number of customers at station i at time t. It is assumed to satisfy a.s. the equations: 



Q?(t) =O?(0) + A?{t) + B?(t) - Df(t), 



K 



(2.1b) 



(2.1a) 



B?co=x;*ii(^f(o), 



(2.1c) 




(2.1d) 



where i > and i G -ffT. The random quantities in ( 12. la[) — ( l2.ld.ll have the following inter- 
pretation: Qf(0) G Z^" is the initial queue length at station i; A™ (t) , (t) , D™ (t) represent 
the cumulative number of exogenous arrivals at station i during the time interval [0,t], the 
cumulative number of endogenous arrivals at station i during the time interval [0, t], and the 
cumulative number of departures from station i during the time interval [0, £], respectively. 

2.2 Assumptions on the network primitives 

Let P = (pij, i,j G K) be a substochastic matrix, R = I — P T , and pi = (pij, j G IK) . We 
denote 



Q (0) 



Q n (Q) 

N t D ' n (nt) - nt 







y/n 

(¥f' n (t), t > 0), 




y/n 

®i([nt\) - pint 
y/n 

(Nf'\ i G K), 



(Nf' n (t), t > 0), 
(*?(*), t > 0), 



r 



(N? i G IK), 
($T, ieK). 



We will need the following conditions. 



(AO) For each n G IV and each i G J , limsup^^ Nf' n {t)/t < oo a.s. 



(Al) The spectral radius of matrix P is strictly less than 1. 



(A2) For each i G IK, 
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(A3) There exist continuous functions Aj(x) and Hi(x) such that 

n n 
uniformly on compact subsets of S, as n — > oo. Furthermore, for x G S, 

X(x) - Rfi(x) = 0. 

(A4) There exists a Lipschitz-continuous function a(x) such that 

-= (X n (^/nx) - Rn n {Vnx)) -> a(x) 
y/n 

as n — > oo uniformly on compact subsets of S. 
(A5) As n -> oo, 

(^(O),^'™,^,^) (X , W A , W D , W*) 

where X Q is a random if- vector, W A , W D , and 14 7 * are continuous-path stochastic 
processes with trajectories in respective spaces D([0, oo), M K ), D([0, oo), M K ), and 
1D)([0,oo),1R KxK ). 

Condition (AO) is needed to ensure the existence of a unique strong solution to the system 
of equations ( 12.1al) -( l2.1dl) . see Lemma [2.11 It is almost a consequence of condition (A5) in 
that the latter implies that \\m n ^ 00 N A,n {nt)/{nt) = 1 in probability. Part (Al) is essentially 
an assumption that the network is open. It implies the existence of a regular Skorohod map 
associated with the network data (see Proposition 13. 2j) which is a key element of the proof 
of the main result. The requirement X(x) = Rfi(x) in (A3) together with condition (A4) 
defines a critically loaded heavy traffic regime. Condition (A5) is the assumption on the 
primitives. The components of W A corresponding to i ^ J vanish. Conditions (A2)-(A4) 
are fulfilled if the following expansions hold: X n {x) = nX\(x/n) + y/nX2(x / y/n) and /i n (x) = 
nfj,i(x/n) + y/nfj,2{x / y/n) , where Ai, A 2 , /ii, and /i 2 are nonnegative bounded continuous 
functions such that Xi(x) = Rfii(x) . If the above functions are constant, then one obtains 
the standard critical loading condition that (A" — Rfi n ) / \fn — > A 2 — /i 2 as n — > oo, cf. Reiman 

Most of the results on diffusion approximation in critical loading (see, e.g., Harrison and 
Reiman [3], Kushner [S]) formulate the heavy traffic condition in terms of rates that are 
C(l) and then consider scaled processes where time is scaled up by a factor of n while space 
is scaled down by a factor of y/n. In the scaling considered here (cf. Mandelbaum and Pats 
[TT] . Yamada [17]) the time parameter is left unchanged and the factor of n is absorbed in the 
arrival and service rates. This is more convenient notationally, however, in the application 
to generalised Jackson networks in Section H] we work with the conventional scaling. 
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Lemma 2.1. Let conditions (AO) and (A2) hold. Then equations (12. lap - (12.1 dp admit a 
unique strong solution Q n , which is a Z^-valued stochastic process. 

The proof is provided in the appendix. Intuitively, the linear growth condition (A2) on 
the total arrival rate, together with the asymptotic bounds (AO), implies that the sample 
paths of the Q™ are nonexplosive. 



3 Main results 



We assume conditions (A0)-(A5) throughout this section. We introduce the "centered" 
processes as follows: For i e IK and t > 0, 



M?{t) =M?' n (t) + M*' n (t) - M^ n (t), 
where 



r D,n, 



M A,n {t) =N ,,n ^ X n ms))ds J _ J XnQ n (s))d8, 
K 

M°> n (t) =J2 -PUD?®) > 

j'=i 



and 



(3.2a) 

(3.2b) 
(3.2c) 



M?' n {t) =Ni 

A 



D,n 



tf(Q n (s))l m{s)>0} ds - / ^(Q n (s))l{Qns)>o}ds 



^)) 1 {Q"(s)>o}^ . (3. 2d) 



We can rewrite the evolution ( 12.1 aft as 



QUt) = Qm 



K 



ds + M^^ + lRY 71 ^)}, 



where Y n (t) = (Y?(t) ,i G JK) and 

17(0 = / i {W =o } /i?(Q n (s)) tfa, < e Jf, 

Jo 



(3.3) 



Note that (YT^t),^ > 0) is a continuous-path non-decreasing process with IT^O) = 0, which 

(3.4) 



increases only when Qf(t) = 0, i.e., / °° ^{Q?(t)^Q}dY™{t) = a.s. Set 

a n (x) = \ n (x) - Rfi n (x). 
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Then the state evolution can be expressed succinctly by the following vector equation: 

Q n (t) = Q n (0) + [ a n (Q n (s))ds + M n (t) + RY n (t), t > 0. (3.5) 
Jo 

The latter dynamic can equivalently be described in terms of a Skorohod map as described 
below. 

Definition 3.1. Let ip £ ©([0, oo), M K ) be given with if)(0) £ S. Then the pair (<f>,rj) £ 
D([0, oo), M K ) x ©([0, oo), M K ) solves the Skorohod problem for if) with respect to S and R 
if the following hold: 

(i) (f)(t) = ip(t) + Rrj{t) £ S, for all t > 0; 

(ii) for i £ IK, (a) rji(0) = 0, (b) r\i is non- decreasing, and (c) rji can increase only when <f> 
is on the i th face of S, that is, J °° l^^^drji^s) = 0. 

Let D 5 ([0,oo),iR x ) = {?/>£ D([0,oo), R K ) : if){0) £ S}. If the Skorohod problem has a 
unique solution on a domain D C ©^([O, oo), iR A ), we define the Skorohod map r on D by 

The following result (see Dupuis and Ishii [3], Harrison and Reiman [5]) yields the regularity 
of the Skorohod map and is a consequence of Assumption (Al). 

Proposition 3.2. The Skorohod map V is well defined on DsQO, oo), M K ) and is Lipschitz 
continuous in the following sense: There exists a constant L > such that for allT > and 
ik,ih £%([0,oo),iR A ) ; 

sup |r(Vi)(t) - r(v 2 )(t)| < l sup K'i(t) - ^ 2 (t)|. 

te[0,T] *6[0,T] 

As a consequence, both and 77 are continuous functions of if). (Note that matrix R is 
invertible under the hypotheses.) 

The dynamic in (13.51) can now be equivalently described in terms of the Skorohod map as 
follows: 

Q n (t) = T (V(0) + ^ a n (Q n (s))ds + M n (-)^ (t), fort>0. (3.6) 

The Lipschitz continuity of the Skorohod map and of the function a(x) imply that the 
equation 

X(t) = T(X + [ a{X{s))ds + M{-))(t), (3.7) 
Jo 

where 

K K 

M,(f) = WfiXMt) + E W *M°)t) - - Partem , (3.8) 

3=1 3=1 
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has a unique strong solution. 

We now state the main result of this paper. For t > and i G IK, let X™(t) = Q?{t) / \/n. 
We also define X = (X(t), t > 0), and X n = ((Xf (t), z = 1, 2, . . . , AT), t > 0) . 

Theorem 3.3. Let conditions (A0)-(A5) hold. Then X n =>- X, as n — > oo . 

To prove this theorem, we first establish certain tightness results. Recall that a sequence 
V n of stochastic processes with trajectories in a Skorohod space is said to be C-tight if the 
sequence of the laws of the V n is tight, and if all limit points of the sequence of the laws of 
the V n are laws of continuous-path processes (see, e.g., Definition 3.25 and Proposition 3.26 
in Chapter VI of Jacod and Shiryaev [7]). 

Lemma 3.4. The sequence of processes (M n (t)/^/n, t > 0) is C-tight. 
Proof. By ( l2~Ta1) - (l2~Tdj) . 

A A A A A , ft 

i=l i=l i=l i=l i=l 

Therefore, for suitable H > 0, on recalling (A2) and denoting Z™(i) = Q™(t)/n, 

E zm < e zm + E su P - ( 1 + T -a>z"( S ))^ 



< E z r(o) + E su p - f 1 + H A 1 + E ^(^)) ) . 

i=i i=i ^ n ^ v Jo <=i / 



By Gronwall's inequality (cf. p. 498 in Ethier and Kurtz [1]), 

A' X A 1 A" 1 

E z "w ^ (E^w + E^p-^^^+^^p^E 8 ^-^'"^)- 

i=i i=i i=i y ^ n y i=i y ^ n y 

By (A5), Nf' n (y)/y — > 1 in probability as y — > oo and n — )■ oo and ^i=i^f(0) — > in 
probability as n — > oo . Therefore, 

A 



lim limsup P(sup V Zf (s) > r) = . (3.9) 

— i=l 

It follows by (A2) that 

lim hmsupP( [\-\nQm) + -l#(Qtt'))) ds>r) = (3.10) 



s 



and that, for 5 > 0, e > 0, T > 0, 



limlimsu P P( sup I (- A?(Q?(s)) + ds > e) = . (3.11) 

<5^0 n ^oo te[0,Tl Jt n 71 



l[0,' 

We have that, for 7 > 0, 5 > 0, e > 0, T > 0, and r > 0, 



sup |^M^(t)-^M^( S )|> 7 )<P(/ - XUQn-s)) ds > r) 
,te[o,T]-. V n V n Jo n 

s-t\<6 

rt+8 1 

+ P(snp / -\?(Q?(s))ds>e)+P( sup |7vf ,n (t) - ]vf '»| > 7) • 

te[0,T]Jt n s,te[0,r]: 

-t\<e 



By (A5), (&m>, and dSHD, 



1 - r A,n/,\ 1 TijrAjrii 



limlimsupP( sup |-=Mf ,n (t) - -^Mf' n (s)| > 7) = . 

5^0 n^oo s ,t6[0,T]: V n V n 

\s-t\<5 

Hence, the sequences of processes (M i A,ri (t)/y / n, £ > 0) are C-tight. A similar argument 
shows that the sequences of processes [M i ' n (t)/^fn, t > 0) and {Mf' n {t)/^/n, t > 0) are 
C-tight, so the sequence of processes (M n (t)/y / n, t > 0) is C-tight. ■ 

Next, we identify the limit points of IT = (M n (t)/^, t>0). 

Lemma 3.5. The sequence of processes M™ converges in distribution, as n — » 00 , to M . 

Proof. From Lemma T3.4[ M n (t)/n — > in probability uniformly over bounded intervals. By 
(A2) and (13.41) . for some H', for all n and x, \a n (nx)\ < H'n(l + \x\) . By ( 13.91) . the sequence 
of processes (f*(l/n)a n (Q n (s))ds, t > 0) is C-tight. By (1331) . the fact that M n (t)/n 
in probability uniformly on bounded intervals, Prohorov's theorem, and the continuity of 
the Skorohod map, the sequence of processes (Q n (t)/n, t > 0) is C-tight and every its limit 
in distribution (q(t), t > 0) satisfies the equation 



q(t) = T[ / (A(g(s)) - Rfi(q(s)))ds (t) . 







Since by (A3), A(x) — R[i(x) = 0, we must have that q(t) = 0, which implies that the 
sequence Q^(t)/n tends to zero as n — > 00 in probability uniformly on bounded intervals. 
Since Y n is expressed as a continuous function of (Q n ,M n ), we have that Y n (t)/n — > in 
probability uniformly over bounded intervals, so by (13. 3p . for z G -/FT, 

1 /■* 

— / /i™(Q n (s))l{Q™( s ) = o}(is — )■ in probability as n — > 00. (3-12) 
n Jo 
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We also have by (A3) that 

A"(Q n (s)) ds — > \i(Q)t in probability as n — > oo (3.13a) 



1 * 



n 
and 



1 f* 

— I fx 7 l(Q n (s)) ds — > Hi(0)t in probability as n — > oo . (3.13b) 
n Jo 

Since by (A5), N?' n (nt)/n -> t in probability as n -»■ oo, by fl2~Tdj) . (A4), fl3TT2|) . and 
d3~T3bl . 

— > tti(0)t in probability as n — > oo. (3-14) 

n 

The convergences in (A5), (I3.13ap . f )3.13b|) . and (I3.14p imply if one recalls the definitions in 
f l3~2b|) . fl3T2c|) . and (jgjd]) that the (M A ' n /^/n, M B > n /s/n, M D > n / y/n) converge in distribution 

to (M A , M B , M D ) , where Mf(t) = Wf(\i(0)t), Mf (t) =J2f =1 W^ N (0)t), M t D (t) = 

Y^f=i($ij ~ Vji)Wf (fij(0)t), so, by ( 13.2a[) and ( 13. 8h . the M™ converge in distribution to 
M . ■ 

Proof of Theorem D We note that by f l3T6|) . 

A n (t) = T (x n (0) + J -j= a n (V^X n (s))ds + M"(-)J (t), for t > 0. (3.15) 

By the Lipschitz continuity of the Skorohod map, (13 .4p . and (A2), for T > and suitable 
H > 0, 

sup \X n {t)\ < \X n {0)\ +L [ -L\a n (^X n {s))\ds + sup \M n {t)\ 
te[o,T] Jo V n v n te[o,T] 

<\X n {0)\+LH [ (1 + \X n {s)\)ds+ sup |M n (t)|. 



n te[o,T] 

Gronwall's inequality, the convergence of the A n (0), and Lemma [3.51 yield 

lim limsupP( sup |A n (t)| > r) = , 

r— >oo n^oo te[0,T] 

so, by (13. 4p and (A4), the sequence of processes (J Q a n (y/nX n (s)) / \/n ds ,t > 0) is C-tight. 

By (13.151) . the convergence of the A n (0), Lemma T3. 51 (A4), Prohorov's theorem, and the 
continuity of the Skorohod map, the sequence of processes (X n (t), t > 0) is C-tight and 
every limit point (X(t), t > 0) for convergence in distribution satisfies the equation 

X{t) = T (x{0) + J a{X{s))ds + M(-)J (i), for t > 0. 

The uniqueness of a solution to the Skorohod problem implies that X(t) = X(t) . ■ 
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4 Generalised Jackson networks with state-dependent 
rates 



In this section, we consider an application to the setting of generalised Jackson networks in 
conventional scaling. Suppose as given mutually independent sequences of i.i.d. nonnegative 
random variables {u l An),i > 1}, {v l k (n),i > 1} for j G J C IK and k G IK. For the 
nth network, the random variable Uj(n) represents the zth exogenous interarrival time at 
station j, while v k (n) is the iih service time at station k. The quantities pij represent the 
probabilities of a job leaving station % being routed directly to station j, which are held 
constant. The routing decisions, interarrival and service times, and the initial queue length 
vector are mutually independent. 

We define 

t$ = (E^(n)])- 1 > 0, s n k = Var(^(n)) > 0, k G K, and 
X] = (Efu^n)])- 1 > 0, a] = Var(«J(n)) > 0, j G J, 

with all of these terms assumed finite and the set J nonempty. It is convenient to let A" = 1 
and dj = for j ^ J . 

Let iv/' n (t) = max{i' : Eti M j( n ) - *} for 3 G J and = max {^' : ELi4W < 

t] for k G K . We may interpret the process (Nj' n (t), t > 0) as a nominal arrival process 
and the random variables v k (n) as the amounts of work needed to serve the jobs. Suppose 
that arrivals are speeded up (or delayed) by a function A"(x), where i G J~, and the service 
is performed at rate p> k {x), where k G IK, when the queue length vector is x. As in Section 

El we let Nf' n (t) = [t\ and A"(x) = for % £ J. In analogy with (IXTajl - (l21d|l the queue 



lengths at the stations at time t, which we denote by Q™(t), are assumed to satisfy the 
equations 

A?(t) =Nf' n ( / K(Q n (s))ds 

A 







m) =Np' n ( f mQ n (sm ms)>0} ds 



where 



i=i 

with {(x?i(f), i = 1,2, Z = 1,2,...} being indicator random variables which are 

mutually independent for different j and I and are such that P(xu(l) = 1) = Pji ■ 
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If we introduce the random variables Q?(t) = Qi(nt), A"(t) = A?(nt), B?(t) = B?(nt), 
Df(t) = Df(nt), Nf> n (t) = N?' n (t/\?), N°> n (t) = N?> n {t/fi), and $™(m) = %m), 
and functions A"(x) = nA"A"(x) and ${x) = then we can see that they satisfy 

equations fl2Ta1) - fl2TTd]) . Condition (AO) holds as Nf' n (t)/t -»■ 1 and N t D ' n (t)/t -»■ 1 a.s. as 



i — > oo . 

If we also assume that Q n (0)/y/n =>■ Xq, that, for fc £ IK and j £ J , 

i4 -> s fe ->■ s fc> 

A™ ->> A j; a™ • > 

as n — > oo , and that 

max sup Fi(vl(n)) 2+e + max sup 'Ei{u 1 An)) 2+,L < oo for some e > 0, 

then condition (A5) holds with Wf = ^/ajXjBf for j £ J", VF/(t) = for j ^ J", and 
VFjf = y/Jk^kB^ for k E K , where .Bj 1 and f?jP are independent standard Brownian motions, 
with $j being a A'- dimensional Brownian motion with covariance matrix E$^(t)$^(t) = 
(Pijfijk — PijPik)t, and with processes Bj 1 , S^, and <3>j being mutually independent. 

Let us assume that the following versions of conditions (A2)-(A4) hold: 



(A2) For each i £ K, 



supsup|^ + ^]<oo, 



(A3) There exist continuous functions Xi(x) and fii{x) such that 

A"(nx) — > \i(x), p^(nx) — > £ii(x) 

uniformly on compact subsets of S, as n — > oo. Furthermore, for x £ S, 

\(x) — Rp(x) = 0, 

where Aj(x) = AjAj(x) and JI^x) = iXifi^x) , 

(A4) There exists a Lipschitz-continuous function a(x) such that 

y/n(\ n (■y/nx) — Rp^(y/nx)) — > a(x) 

as n — > oo uniformly on compact subsets of S, where X i (x) = A"A"(x) and /Zf (a?) 
$${x) . 
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Then the process M in (I3.7P and (13.81) is a i^-dimensional Brownian motion with covari- 
ance matrix A which has entries 

K 

An = Aj(0)Afaj + fj,i(0)f4si(l - 2pu) + (0)^^(1 - Pji + Pjiftfsj) for i G IK, 

3=1 

and 



Ai 



k=i 



for 1 < % < j < K. 



An application of Theorem 13.31 yields the following result. 



Corollary 4.1. //, in addition to the assumed hypotheses, condition (Al) holds, then the 
processes {Q n {nt)/ \fn, t > 0) converge in distribution to the process (X(t), t > 0) with 



X(t) = r(x + ^ a(X(s))ds + A 1/2 B(-))(t), 



where B(-) is a K -dimensional standard Brownian motion. 

Remark 4.2. The conditions on the asymptotics of the arrival and service rates essen- 
tially boil down to the assumptions that the following expansions hold: A (x) = \\{x/n) + 
I \pn) I \pn andJL n (x) = Jl^x/n) +pZ 2 {x j \[n) j yjn with suitable functions Ai, A2, fix, and 

TV 

Remark 4.3. //, in addition, the assumption of unit rates is made, that is A"(x) = 1 for 
j G J and fi^(x) = 1 for k G IK, then the limit process is a K -dimensional reflected 
Brownian motion on the positive orthant with infinitesimal drift a(0) and covariance matrix 
A, and the reflection matrix R = I — P T , as in Theorem 1 of Reiman J73J/. 

Remark 4.4. In order to extend applicability, one may consider independent sequences of 
weakly dependent random variables {u l j(n),i > 1}, {vl(n),i > 1} for j G J C IK and 
k G IK. Under suitable moment and mixing conditions which imply the invariance principle, 
cf., e.g., Herrndorf Peligrad IWJ , Jacod and Shiryaev [Tj^ Corollary \4-l\ continues to 
hold. 
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Appendix 



Proof of Lemma 12.11 The proof is an adaptation of the one in Puhalskii and Simon [T4l 
Lemma 2.1] and employs the approach of Ethier and Kurtz [H Theorem 4.1, p. 327]. Let 



K 



e n (x) = i + 5>*(:z) + a?(x)) 



i=l 



£?(*) 



6 n (x) 



6 n (x) ' 

and s 

r n {t) = inf{s : / e n {Q n {u)) du > t} . 



We note that r n (t) is finite- valued, differentiate, dr n (t)/dt = l/9 n (Q n (r n (t)) and r n (t) -> 
oo as t — 7- oo . One can see that if the process Q n satisfies a.s. the equations 



QUt) = QU0) + Nf' n [ I XUQ n (s))ds 



K 



+ E $ £ (< ( / ^(Q n (s))l {Qlis>0} ds] 

j=l J o J 

- N^ n ^^(Q n (s))l { Qns)>o}ds) ,t > 0, (Al) 

then the process Q n = (Q n (t) ,t > 0) defined by Q n {t) = Q n (T n (t)) satisfies a.s. the 
equations 



+ E ^ (jf Ai(^(^))l { Q«( S )>0}^ 



-iV. 



D,n 



^(Q n (s))l ms)>0} ds),t>0. (A2) 
On the other hand, suppose a Z^--valued process Q n satisfies a.s. flA2j) and let 

f n (t) = mi{s : f 1 du > t} . 

Jo e n (Q n (u)) 
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We show that f n (t) is well defined for all t a.s. Since by condition (A2), for a suitable 
constant L n , 9 n (x) < L n (l + x), we have that 

I p I I r» i 
du > — — / — - du > — — / T7 — - a du, 



o en(Qn( u )) "- l-j i + y« =1 QUu) ~ L n Jo i + E£i Qm + E£i N f' n ^ 



(A3) 

where the latter inequality uses the fact that by ( 1A2I) 

^ E*(o) + fx ,n ( fximu))du) 

i=l i=l i=l ^° 

and that A™(x) < 1. Since limsup^oQ ,n (t)/t < oo a.s., the rightmost integral in (1A3|) 
tends to infinity as t — > oo a.s., so does the leftmost integral, which proves the claim. In 
addition, f n {t) is differentiable, df n {t)/dt = 6 n (Q n (r n (t)) and f n {t) -> oo as t -> oo a.s. It 
follows that Q n (t) = Q n (f n {t)) satisfies flU) a.s. 

Thus, existence and uniqueness for flAlj) holds if and only if existence and uniqueness 
holds for (1A2|) . The existence and uniqueness for flA2j) follows by recursion on the jump 
times of Q n . In some more detail, we define the processes Q n,e = (Q n,e (t), t > 0) with 
Q n ' e (t) = (Qf(t), i = 1, 2, . . . , K) by Q?'°(t) = Q?(0) and, for £ = 1, 2, . . ., by 



= Q?(0) + ivf'" ( J \nQ n/ -\s))ds) 

+ E^(^' n (/V-(Q n/ - 1 (^))i { Q r - (s)>0} ^ 

■ i «/ 



{Qr~ L (s)>o} 1 

Let r n,£ represent the time epoch of the £th jump of Q n,e with r n, ° = . One can see that 
Q n >\t) = g n '°(0) if t < r"- 1 . It follows that (Q 11 ' 1 ^), t > 0) and (Q n ' 2 (t), t > 0) experience 
the first jump at the same time epoch and the jump size is the same for both processes, so 

T n,l < T n,2 and Qn,l( t A r n,l) = Qnjity fo r t < r «,2 _ Wg define Qn^ = Qn(Q) for t < r"' 1 

and Q n {t) = Q n,1 (t) for r"' 1 < t < r n ' 2 . Similarly, for an arbitrary I G IV, we obtain 
that T n > e < T n > £+1 and Q n ' e (t A T n ' e ) = Q n > e+1 (t) for t < r n ' e+1 . We let Q n {t) = Q n ' £ (t) 
for r n,< < t < r n ' e+1 . The process Q n is defined consistently for t G U^ 1 [r n ^~ 1 , r n ' e ) . If 

T n,£+1 = ^ for gome ^ then we let Qn^ = Qnjty fo r all f > r n/ _ 

Suppose that T n,e < oo for all i. Then Q n (t) has been defined for all t < r n,oc = 
lim^oo r n ' e and satisfies (IA2j) for these values of t . We now show that r n '°° = oo . The set 
of the time epochs of the jumps of Q n is a subset of the set of the time epochs of the jumps 
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of the process Q n = (Q n (t), t > 0), where 



+ ^(^^(Q"^ 1 («))1 { Q^- 1(S )>0}^))- 

Since the process Q n has infinitely many jumps, so does the process Q n . Since Xf(x) < 1, 
1^2 (x) < 1 and $^(7711) — $"j(m 2 ) < mi — m 2 for mi > m 2 , the lengths of time between the 
jumps of Q n are not less than the lengths of time between the corresponding jumps of the pro- 
cess (Ef =1 Nt' n (t) + Y!U ^' n (*)» * > 0) ■ The P rocess (Ef=i ^(*) + Ef=i N^(t),J> 
0) having infinitely many jumps, the time epochs of the jumps of (X)j=i ' n (^)+Si=i -^i ^ — 

O) tend to infinity as the jump numbers tend to infinity. Thus, r n,0 ° = 00 a.s. 

The provided construction shows that Q n is a suitably measurable function of N A ' n , 
N D,n , and $ n , so it is a strong solution. We have proved the existence of a strong solution 
to ( 1A2I) . A similar argument establishes uniqueness. ■ 
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